Papers with evidence extraction
Automated Evidence Extraction and Scoring for Corporate Climate Policy Engagement: A Multilingual RAG Approach (2025.emnlp-demos)
Copied to clipboard
| Challenge: | InfluenceMap's LobbyMap Platform monitors the climate policy engagement of over 500 companies and 250 industry associations . however, a significant portion of the analysis remains manual, making it time- and labor-intensive and susceptible to human error. |
| Approach: | They propose an AI-assisted framework that leverages Retrieval-Augmented Generation to accelerate the monitoring of corporate climate policy engagement. |
| Outcome: | The proposed framework accelerates the monitoring of corporate climate policy engagement by leveraging Retrieval-Augmented Generation to extract and classify evidence from multilingual corporate documents. |
REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-training (2021.findings-acl)
Copied to clipboard
| Challenge: | Pre-trained language models have achieved great success on Machine Reading Comprehension (MRC) however, the poor support in evidence extraction hinders them from further advancing MRC. |
| Approach: | They propose a REtrieval-based pre-training approach that strengthens evidence extraction during pre-training by inherited downstream MRC tasks. |
| Outcome: | The proposed approach strengthens evidence extraction during pre-training, which is further inherited by downstream tasks. |
FAKTA: An Automatic End-to-End Fact Checking System (N19-4)
Copied to clipboard
| Challenge: | Existing studies have investigated individual components of fact checking process but none offer such a capability. |
| Approach: | They propose a framework that integrates various components of a fact-checking process. |
| Outcome: | The proposed framework integrates various components of a fact-checking process to predict the factuality of claims and provide evidence at the document and sentence level to explain its predictions. |
AQE: Argument Quadruplet Extraction via a Quad-Tagging Augmented Generative Approach (2023.findings-acl)
Copied to clipboard
| Challenge: | Argument mining involves multiple subtasks, but each one is insufficient for understanding argumentative structure and reasoning process. |
| Approach: | They propose a quadruplet extraction task that extracts four argumentative components . they use a generative quadragging module to augment the training of the generative framework . |
| Outcome: | The proposed method can extract arguments from a large-scale dataset. |
Too much of product information : Don’t worry, let’s look for evidence! (2023.emnlp-industry)
Copied to clipboard
| Challenge: | Existing product question answering models do not provide labelled data for the task and description information for products is very lengthy. |
| Approach: | They propose a distant supervision-based NLI model to prepare training data without manual efforts. |
| Outcome: | The proposed model outperforms standard multi-task fine-tuning and improves 6% in human evaluation over baselines. |
IAM: A Comprehensive and Large-Scale Dataset for Integrated Argument Mining Tasks (2022.acl-long)
Copied to clipboard
| Challenge: | Argument mining (AM) is a computational process that is used to analyze information in a debating system. |
| Approach: | They propose to use a large dataset to automate the manual process of debating . they propose to integrate claim extraction, stance classification and evidence extraction tasks . |
| Outcome: | The proposed tasks can extract claims, stances, evidence and more from a large dataset . the proposed tasks are highly efficient and can be applied to argument mining tasks . |
Guaranteeing Knowledge Integration with Joint Decoding for Retrieval-Augmented Generation (2026.acl-long)
Copied to clipboard
Zhengyi Zhao, Shubo Zhang, Zezhong Wang, Yuxi Zhang, Huimin Wang, Yutian Zhao, Yefeng Zheng, Binyang Li, Kam-Fai Wong, Xian Wu
| Challenge: | Retrieval-Augmented Generation (RAG) provides access to external knowledge, but current research focuses on retrieval quality and 'integration bottleneck' . |
| Approach: | They propose a framework that explicitly decouples reasoning from evidence integration by generating an 'Inner-Answer' and a 'Refer-Aswer" they propose 'a joint decoding mechanism that dynamically fuses the logical coherence of the Inner-Andswer with the factual precision of the Refer-Adswer at the token level' |
| Outcome: | The proposed framework improves accuracy by 12.1% and reduces hallucinations by 16.3% on five QA benchmarks. |
Bridging the Pose-Semantic Gap: A Cascade Framework for Text-Based Person Anomaly Search (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for person anomaly search fail to address the complexities of real-world security, authors say . Existing approaches fail to detect subtle semantic distinctions, authors argue . |
| Approach: | They propose a framework that decouples retrieval into two stages . structure-aware coarse retrieval and detective squad interaction are proposed . |
| Outcome: | The proposed framework achieves state-of-the-art performance by balancing efficiency and semantic reasoning. |
Answering while Summarizing: Multi-task Learning for Multi-hop QA with Evidence Extraction (P19-1)
Copied to clipboard
Kosuke Nishida, Kyosuke Nishida, Masaaki Nagata, Atsushi Otsuka, Itsumi Saito, Hisako Asano, Junji Tomita
| Challenge: | Question answering (QA) using textual sources for purposes such as reading comprehension has attracted much attention. |
| Approach: | They propose a Query Focused Extractor model for evidence extraction and multi-task learning with the QA model. |
| Outcome: | The proposed model achieves state-of-the-art evidence extraction score on hotpotQA and FEVER, which is a recognizing textual entailment task on a large textual database. |
Right for the Right Reason: Evidence Extraction for Trustworthy Tabular Reasoning (2022.acl-long)
Copied to clipboard
| Challenge: | Recent studies show that tabular reasoning models use spurious correlations and focus on false evidence or ignore it altogether. |
| Approach: | They propose a task where models need to extract evidence and then inference labels . they crowdsource evidence row labels and develop unsupervised evidence extraction strategies . |
| Outcome: | The proposed approach outperforms baseline models on the inference task using only the automatically extracted evidence as the premise. |
Weakly- and Semi-supervised Evidence Extraction (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to combine evidence annotations with document labels are limited to a minority of training examples. |
| Approach: | They propose to combine evidence annotations with abundant document labels for evidence extraction task. |
| Outcome: | The proposed method outperforms baselines on two classification tasks with evidence annotations. |
Enrich-on-Graph: Query-Graph Alignment for Complex Reasoning with LLM Enriching (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods employ resource-intensive, non-scalable workflows reasoning on vanilla KGs, but overlook this gap. |
| Approach: | They propose a flexible framework that leverages LLMs’ prior knowledge to enrich KGs and bridge the semantic gap between queries and graphs. |
| Outcome: | The proposed framework bridges the semantic gap between structured knowledge graphs and unstructured queries while ensuring low computational costs, scalability, and adaptability across different methods. |
Evidence Retrieval for Fact Verification using Multi-stage Reranking (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evidence retrieval methods are limited by single-stage evidence extraction. |
| Approach: | They propose to use a multi-stage reranking paradigm to enhance the fact verification process by increasing the recall of sentences by 7.85%, tables by 8.29% and cells by 3% compared to the current state-of-the-art. |
| Outcome: | The proposed system outperforms state-of-the-art models and achieves a 93.63% recall rate for Wikipedia pages. |
Attribute or Abstain: Large Language Models as Long Document Assistants (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to attribution have only been evaluated in RAG settings, where initial retrieval confounds performance. |
| Approach: | They propose to use a benchmark to evaluate attribution on long document tasks . they find that citations and additional retrieval perform best for large models . |
| Outcome: | The proposed approach performs best on large and fine-tuned models, while additional retrieval can help for small, prompted models. |
MASS-RAG: Multi-Agent Synthesis Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are widely used in retrieval-augmented generation (RAG) when retrieved contexts are noisy, incomplete, or heterogeneous, a single generation process often struggles to reconcile evidence effectively. |
| Approach: | They propose a multi-agent synthesis approach to retrieval-augmented generation that structures evidence processing into multiple role-specialized agents. |
| Outcome: | Experiments on four benchmarks show that MASS-RAG consistently improves performance over strong RAG baselines. |
Learning to Extract Rational Evidence via Reinforcement Learning for Retrieval-Augmented Generation (2026.findings-acl)
Copied to clipboard
| Challenge: | Retrieval-Augmented Generation (RAG) is effective in Large Language Models (LLMs). However, retrieval noises undermine the quality of LLMs’ generation, necessitating the development of denoising mechanisms. |
| Approach: | They propose a model which integrates reasoning and extracting into one unified trajectory, followed by knowledge token masking to avoid information leakage. |
| Outcome: | Extensive experiments on five benchmark datasets show the superiority of EviOmni, which provides compact and high-quality evidence, enhances the accuracy of downstream tasks, and supports both traditional and agentic RAG systems. |
The Anatomy of Evidence: An Investigation Into Explainable ICD Coding (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing systems that use explainability methods have limited their effectiveness due to a lack of annotated data. |
| Approach: | They propose match measures and highlight success and failure cases to improve automatic medical coding. |
| Outcome: | The proposed models show that ground truth evidence aligns with code descriptions to a certain degree. |
Natural Language Processing in Support of Evidence-based Medicine: A Scoping Review (2025.findings-acl)
Copied to clipboard
| Challenge: | Evidence-based medicine (EBM) is at the forefront of modern healthcare, emphasizing the use of the best available scientific evidence to guide clinical decisions. |
| Approach: | They propose to investigate the use of Natural Language Processing (NLP) techniques to identify, appraise, synthesize, apply, and disseminate evidence in EBM. |
| Outcome: | The proposed methods support the five fundamental steps of EBM—Ask, Acquire, Appraise, Apply, and Assess. |
Query-driven Document-level Scientific Evidence Extraction from Biomedical Studies (2025.acl-long)
Copied to clipboard
Massimiliano Pronesti, Joao H Bettencourt-Silva, Paul Flanagan, Alessandra Pascale, Oisín Redmond, Anya Belz, Yufang Hou
| Challenge: | Systematic reviews are widely regarded as the gold standard in evidence-based medicine, heavily influencing medical decisions made by doctors, health authorities, and patients. |
| Approach: | They propose a retrieval-augmented generation framework to tackle the unique challenges of evidence extraction by leveraging forest plots from Cochrane systematic reviews. |
| Outcome: | The proposed framework outperforms existing methods by up to 10.3% in the F1 score on this task. |
Evidence-Augmented Policy Optimization with Reward Co-Evolution for Long-Context Reasoning (2026.acl-long)
Copied to clipboard
| Challenge: | Evidence-Augmented Policy Optimization (EAPO) improves long-context reasoning performance . Xu et al., 2025): large language models are a critical part of NLP . |
| Approach: | They propose an Evidence-Augmented Reasoning paradigm that uses a group-relative reward to improve evidence quality. |
| Outcome: | EAPO significantly improves long-context reasoning performance compared to baselines. |